Introducing and Using Electronic Voting Systems in a Large Scale Project With Undergraduate Students : Reflecting on the Challenges and Successes

Electronic Voting Systems (EVS) have become a popular medium for encouraging student engagement in class-based activities and for managing swift feedback in formative and summative assessments. Since their early days of popularity and introduction some five or more years ago, the author’s UK based University has been successful in refining strategies for their use across individual academic Schools and Departments, as previously reported at ECEL (e.g. Lorimer and Hilliard, 2008). The focus of this paper is a reflection on the introduction of EVS with 300 first year undergraduate students in the School of Computer Science, within the context of a wider ‘change’ project in teaching and learning affecting the whole institution. The author examines what lessons can be learnt following this rapid scaling up of EVS activity both at a local level and more widely across an HE institution and in reflecting on the successes and challenges of this experience provides key indicators for success and useful support for others considering using EVS. The paper first considers the landscape of EVS use within the UK and then the specific introduction of EVS at her own institution, before exploring the issues in her own academic School around the latest phase of their introduction as part of an institution–wide project to review measures to support assessment and feedback.Non peer reviewe

Planning for Success in Introducing and Embedding Technology to Enhance Learning

The authors reflect on the outcomes of recent change management projects for introducing technology into Higher Education in the UK and discuss key aspects which have led to success in the increasing use and subsequent embedding of learning technologies in the classroom. They focus on three areas where it is suggested that institutions need to ‘get it right’ in terms of justifying the expensive introduction of technology into the learning environment: the building and maintaining of the technical infrastructure; the provision of appropriate initial and continuing user support, which includes relating the use of technology to pedagogy; and the management of the impact of change on those who are faced with adapting to different ways of learning and teaching. These are mapped to a set of critical success factors by the authors. The paper investigate these firstly, via a case-study within a technology-focussed university, where its commitment to the enhancement of the student experience through using technology to support assessment and feedback mechanisms has increased. The authors explore how academics were encouraged to become further engaged within the process. Consequently, the use of technology in the classroom was no longer seen as being the preserve of a group of ‘enthusiasts’ or ‘early adopters’ but was perceived to be relevant to a wider user group. A further case-study shows how the critical success factors were applied to develop a flexible learning module within a more traditional teaching environment. This paper explores the importance of balancing underlying pedagogical approaches to the introduction of new technologies. It is proposed that while technology can be an excellent tool it should not drive the pedagogy. The aim finally is to ensure that throughout and following a period of change both academics and students can benefit from the appropriate use of technology to enhance learnin

Report on the Evaluation of EVS Usage and Trends at the University of Hertfordshire : February to June 2014

The Electronic Voting Systems (EVS) evaluation project for iTEAM has investigated the current level of engagement in the use of EVS across the institution in 2014. It has built on the work and outputs of the JISC supported Evaluating Electronic Voting Systems (EEVS) project in 2011-12 and the work of the iTEAM project through 2011-2013. It offers an up-to-date examination of the trends in EVS adoption and the breadth and nature of EVS use across the different academic schools. The project adopted a mixed-methods approach to evaluate usage and engagement. The starting point was a desk study to examine the existing data on numbers of EVS handsets purchased by academic schools in 2011, 2012 and 2013 and registered across the University and to explore the details from the School reports previously submitted to iTEAM. Sources of data included Information Hertfordshire and the iTEAM archive. Quantitative surveys were drawn up and information requests for student numbers were made to Senior Administrative Managers (SAM). A series of interviews were held with School-based academics including EVS Champions and Associate Deans for Learning and Teaching. Three purchasing trends for EVS handsets by different Schools were found:- slow decrease in HUM, LAW and PAM, moderate increase in BS, EDU and HSK and rapid increase in CS, ET and LMS. In terms of levels of EVS usage in 2013 -14 four different patterns emerged among the schools. These showed: slow increase (CS, LMS and PAM), slow decrease (BS, ET, EDU and HUM), rapid decrease (LAW) and no change (CA and HSK). The EVS purchasing and usage trends comply with the figures given by Rogers for his technology adoption model. Some schools are characterised by successful ongoing EVS use over several years while other school strategies for EVS, which had showed promise early on, have faltered in their use. There was some evidence that academics in STEMM subjects are more likely to engage willingly with EVS use where larger groups are taught, but this is not yet in evidence across all the STEMM groups at this university. Furthermore good practice exists and flourishes across non-STEMM subjects as well. The strategies for successful School-based EVS embedding and continued use include the following three hallmarks:- •Top-down management support for purchasing of handsets and including training for academics and administrators, and alignment with the School teaching and learning strategy. •The existence of a core of innovators and early adopters of technology including the local EVS champions, who are willing to actively engage with their fellow colleagues in sharing the potential of EVS technology. •An engagement with the pedagogical implications for changing and developing practice that the greater use of formative or summative polling and questioning requires. The immediate future of classroom technologies such as EVS offers two main directions. Firstly, there is the continuation of adopting ‘institutionally provided’ handheld devices. This is a low-cost method that can be used easily and flexibly. The other options for classroom polling rely on sufficient wifi availability in the teaching rooms and/or mobile phone signal strength/network availability and capacity. It is anticipated that the capacity issue will present fewer barriers for adoption in future, and that the future of the classroom response systems is inevitably linked to the widespread use of mobile technologies by students

Video diaries: : a discussion of their use for researching the learner experience in higher education

This is the accepted version of the following article: Amanda Jefferies, ‘Video diaries: a discussion of their use for researching the learner experience in higher education’, International Journal of Learning Technology, Vol 10 (3): 237-250, published by Inderscience Publishers, October 2015. The version of record is available online via doi: http://dx.doi.org/10.1504/IJLT.2015.072359This paper considers the rationale for using video diaries as a method of qualitative data gathering for research into students’ experiences of higher education (HE). In particular, the paper considers how video diaries have been employed for researching students’ views and attitudes to their own learning and development. The paper examines the literature on the purpose of reflective video diary research as the method has moved beyond its initial primary development in medical research and specifically into their use in HE. The particular benefits of personal video-diary compilation are considered in terms of the autonomy of the participant. A methodology for employing video diaries as a research method for data collection is discussed within the context of three case studies with undergraduate students at a UK university. The conclusions highlight the unique value of participant-generated video diaries for researching the nature of the student learning experience in HE.Peer reviewe

The Blended Learning Unit, University of Hertfordshire: A Centre for Excellence in Teaching and Learning, Evaluation Report for HEFCE

The University of Hertfordshire’s Blended Learning Unit (BLU) was one of the 74 Centres for Excellence in Teaching and Learning (CETLs) funded by the Higher Education Funding Council for England (HEFCE) between 2005 and 2010. This evaluation report follows HEFCE’s template. The first section provides statistical information about the BLU’s activity. The second section is an evaluative reflection responding to 13 questions. As well as articulating some of our achievements and the challenges we have faced, it also sets out how the BLU’s activity will continue and make a significant contribution to delivery of the University of Hertfordshire’s 2010-2015 strategic plan and its aspirations for a more sustainable future. At the University of Hertfordshire, we view Blended Learning as the use of Information and Communication Technology (ICT) to enhance the learning and learning experience of campus-based students. The University has an excellent learning technology infrastructure that includes its VLE, StudyNet. StudyNet gives students access to a range of tools, resources and support 24/7 from anywhere in the world and its robustness, flexibility and ease of use have been fundamental to the success of the Blended Learning agenda at Hertfordshire. The BLU has comprised a management team, expert teachers seconded from around the University, professional support and a Student Consultant. The secondment staffing model was essential to the success of the BLU. As well as enabling the BLU to become fully staffed within the first five months of the CETL initiative, it has facilitated access to an invaluable spectrum of Blended Learning, research and Change Management expertise to inform pedagogically sound developments and enable change to be embedded across the institution. The BLU used much of its capital funding to reduce barriers to the use of technology by, for example, providing laptop computers for all academic staff in the institution, enhancing classroom technology provision and wirelessly enabling all teaching accommodation. Its recurrent funding has supported development opportunities for its own staff and staff around the institution; supported evaluation activities relating to individual projects and of the BLU’s own impact; and supported a wide range of communication and dissemination activities internally and externally. The BLU has led the embedding a cultural change in relation to Blended Learning at the University of Hertfordshire and its impact will be sustained. The BLU has produced a rich legacy of resources for our own staff and for others in the sector. The University’s increased capacity in Blended Learning benefits all our students and provides a learning experience that is expected by the new generation of learners in the 21st century. The BLU’s staffing model and partnership ways of working have directly informed the structure and modus operandi of the University’s Learning and Teaching Institute (LTI). Indeed a BLU team will continue to operate within the LTI and help drive and support the implementation of the University’s 2010-2015 Strategic plan. The plan includes ambitions in relation to Distance Learning and Flexible learning and BLU will be working to enable greater engagement with students with less or no need to travel to the university. As well as opening new markets within the UK and overseas, even greater flexibility for students will also enable the University to reduce its carbon footprint and provide a multifaceted contribution to our sustainability agenda. We conclude this executive summary with a short paragraph, written by Eeva Leinonen, our former Deputy Vice-Chancellor, which reflects our aspiration to transform Learning and Teaching at the University of Hertfordshire and more widely in the sector. ‘As Deputy Vice Chancellor at Hertfordshire I had the privilege to experience closely the excellent work of the Blended Learning Unit, and was very proud of the enormous impact the CETL had not only across the University but also nationally and internationally. However, perhaps true impact is hard to judge at such close range, but now as Vice Principal (Education) at King's College London, I can unequivocally say that Hertfordshire is indeed considered as the leading Blended Learning university in the sector. My new colleagues at King's and other Russell Group Universities frequently seek my views on the 'Hertfordshire Blended Learning' experience and are keen to emulate the successes achieved at an institutional wide scale. The Hertfordshire CETL undoubtedly achieved not only what it set out to achieve, but much more in terms of scale and impact. All those involved in this success can be justifiably proud of their achievements.’ Professor Eeva Leinonen, Vice Principal (Education), King's College, Londo

The Long March or Bold Strokes : Comparing Strategies for Adopting EVS Learning Technology at a UK University

In recent years there has been much encouragement to investigate the use of classroom technologies to enhance the student learning experience especially in the STEM subjects but now extending across other subject areas as well. A typical classroom technology is electronic voting system (EVS) handsets which allow a lecturer to invite students to vote for their choice from a selection of given answers. Recently, a medium-size UK University has purchased over 9000 EVS handsets for use across the academic Schools as an innovative means for supporting formative and summative testing. Numerous training and support sessions have been provided to staff with the intention of supporting new and experienced users and increasing the take up by academics. As noted in earlier research reported at ECEL 2013, the student feedback was very positive for the use of EVS for formative activities, and less so, for its use in summative assessment. A recent review of the trends of EVS adoption at the University has been undertaken to inform decision-making and future use and support for the technology. One aspect of this review has considered the effectiveness of the strategies adopted by different academic Schools. EVS adoption and use across the University has been compared and placed within Rogers’ theory of the diffusion of innovation. This paper further considers a set of six different strategies adopted for EVS use by academic Schools. They have been categorised according to several variables, including their choice of speed of uptake and the number of handsets in use. The inherent strengths and possible weaknesses of the approaches adopted are considered. Among the questions raised were, does a strategy of large-scale technology adoption over a short time period indicate a greater likelihood of long term engagement and ultimate adoption of the technology? Or, does a longer elapsed time taken for a gradual purchase and adoption of EVS technology suggest a greater inclination for the embedding of technology for enhancing learning? What other success factors should be considered alongside the training and support provided for technology adoption to enhance the likelihood of long term adoption of classroom technologies? The discussion provides a comparison of six different strategies identified across the university and the rationale behind them and then proposes a set of strategy choices which can lead to a greater likelihood of successful adoption of classroom technology

Are our students digitally ready for HE study? : Exploring student attitudes to blended online study in a campus-based university

Date of Acceptance: 26/08/2015The outcomes of a survey of Australian Engineering undergraduates on a campus-based blended course offer a snapshot of trends in student ownership of technologies and a view of student attitudes and preferred choices of hardware and software to support their learning experiences during their first year at university. This paper reports that students in this cohort indicated high levels of prior digital literacy coupled with high personal ownership of multiple technologies. The ensuing conversations and the outputs from the survey indicated that students were keen to use digital technologies including the Learning Management Systems (LMS) to support their learning. They reported an increased use of social media for studying with other students. This was in addition to their prior personal use of social networks for staying in touch with friends and family. The students were however unfamiliar with both the idea and the expectation from their tutors of extensive online preparation prior to their face to face classes, The discussion considers this study in the context of recent research into student experiences from the USA (Dahlstrom, 2012) and from the UK (Beetham and White, 2013). The latter recorded similar conclusions from their research into UK located students in terms of readiness to study at university, noting that students had ‘indistinct ideas about how they will learn at university and what constitutes legitimate learning practice – especially digital practice – in a university context.’Peer reviewe

Mobile Application Usability: Heuristic Evaluation and Evaluation of Heuristics

Ger Joyce, Mariana Lilley, Trevor Barker, and Amanda Jefferies, 'Mobile Application Usability: Heuristic Evaluation and Evaluation of Heuristics', paper presented at AHFE 2016 International Conference on Human Factors, Software, and Systems Engineering. Walt Disney World, Florida USA, 27-31 July 2016Many traditional usability evaluation methods do not consider mobile-specific issues. This can result in mobile applications that abound in usability issues. We empirically evaluate three sets of usability heuristics for use with mobile applications, including a set defined by the authors. While the set of heuristics defined by the authors surface more usability issues in a mobile application than other sets of heuristics, improvements to the set can be made

Validating a social media typology with machine learning and focus groups

This document is the Accepted Manuscript of the following paper: Guy Saward and Amanda Jefferies, ‘Validating a social media typology with machine learning and focus groups’, in Proceedings of the 15th European Conference on E-Learning. Prague, Czech Republic 27-28 October 2016. Jarmila Novotna and Antonin Jancarik eds., ISBN 978-1-911218-18-0, e-ISBN 978-1-911218-17-3. Published by Academic Conference Publishing International (ACPI).Social media networks (SMN) are an established part of the learning landscape in which our students reside as digital inhabitants. Our work is built around an ongoing four-year survey of student attitudes and engagement with SMN and their educational use. Our pre-conceptions were that students would be less keen on engaging with staff via social media. However, the survey results showed only 14% of students against this. Using machine learning to investigate whether those for academic SMN use (dubbed “integrationists”) could be separated from those against (“separatists”) showed it was hard to predict students’ attitudes purely based on their patterns of use of SMN. The complexity of the issues is reflected by focus group work that identified SMN as just one part of a complex pattern of personal communication. For some, Facebook (FB) consumed more time compared to text/email, but the latter were seen as more privileged with use restricted to higher value conversations and participants. Other insights included conflicted views on the value of SMN, a functional view of SMN alerts, and the lack of immersion in academic SMNs. These results suggest SMN are not a panacea for student engagement. Care must be taken in designing effective learning conversations using appropriate media and interaction. Slavishly adopting social practices from SMN will not automatically benefit learners and may leave them more disengaged and distracted than everFinal Accepted Versio